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ABSTRACT 



Purpose . The present research to develop auto-instructional materials 
capable of developing creative behavior in students (based on materials de- 
veloped in a creative problem-solving course) is the first stage of a? contem- 
plated long-range period of research activity designed to ascertain the following: 
To what extent can auto-instructional materials provide for deliberate develop- 
ment of students' creative behavior and at the same time assure mastery of 
subject matter? The total project would thus couple the creative trend in 
American education with the requisite acquisition of course content. 

The objectives of the research were: (a) to determine, by the use of 
experimental and control subjects, whether or not subjects receiving creative 
problem-solving training by programmed methods alone show increases in 
creative ability to the same extent as do subjects receiving the same error-free 
programmed materials by instructor-taught methods, and whether or not either 
or both of these groups show a significant gain in creative ability when com- 
pared with control subjects receiving no training; and (b) to study the attitudes 
toward the course of students taking the programmed version alone as compared 
with those receiving the programmed materials via an instructor. 

Procedure. The population consisted of high-school seniors who in- 
tended to continue their formal education after graduation. The majority of 
those eligible volunteered for the experiment. All were students in the aca- 
demic high schools of the Buffalo Public Schools*. 

Three groups of 62 subjects each (randomly selected from 1, 086 who 
requested to be included in the experiment) were matched on the basis of the 
Lorge-Thorndike I. Q. The first group consisted of experimental subjects 
taking the program with an instructor; the second group was made up of experi- 
mental subjects taking the program alone; the third group served as a control, 
receiving no training between the pre-tests and post-tests that were given to 
all three groups. 

One week— two hill periods— was used for the battery of eleven psy- 
chological pre-tests for all three groups. Then thirteen weeks— two periods 
per week — were used for the course for the two experimental groups. Students 
were assigned to classes, in their own high schocls, during their study periods. 
Each class met twice a week during the entire semester. There was no re- 
quired outside work. Finally, one week— two foil periods— was used for the 
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battery of eleven psychological post-tests for all three groups. 

Six different schools were used to prevent contamination— i. e. , to 
eliminate discussion between groups— and to minimize possible replication 
error. However, additional ''in-the-same-school" control groups were also 
used for comparison purposes. Since there turntd out to be no evidence of 
contamination, the results to be reported include these "in-the-same-school" 
comparisons. 

The logic of the experiment required the use of three separate analyses, 
each with a two-by-three factorial design. Analysis-of-variance and -covari- 
ance techniques were employed. 

Results and Conclusion . The experimental students, on almost every 
test, made greater gains than did the control students. In almost all of the 
measures, the gains of the instructor-taught programmed-groups were sig- 
nificantly superior to that of both control groups. In the case of the groups 
who took the program alone, the students were significantly superior to the 
control students in gains on most tests, but not to as large a degree. In 
other words, the instructor -taught groups tended to be more markedly and 
consistently superior to the control groups than did the students who had the 
program without an instructor. 

In summary, the pattern of results on the various tests of creative 
ability permits the generalization that the instructor-taught programmed- 
groups were superior to those who took the program alone and to both control 
groups; and the groups that took V 5 program alone were superior to both con- 
trol groups. The tests most representative of this outcome were Planning 
Elaboration, Product Improvement Fluency, and Product Improvement Flexi- 
bility; and Alternate Uses, Other Uses, Product Improvement Originality, and 
Consequences Total gave essentially the same pattern of results. 



With respect to student reactions to the course, the instructor-taught 
students found the course more interesting and felt they gained more from it; 
however, both groups appeared to report equal application of what they had 
learned and seemed to feel they would apply it equally as well in the future. 

Further Plans . Further analyses will be made of the present data and 
of further pilot data collected during the project. Additional research is also 
planned on related aspects of the problem. Manuals are being developed re- 
garding use of the programmed materials. 
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I. THE PROBLEM 



Discussion of the problem includes treatment of several pertinent aspects: 
definition of creativity; the significance of creative ability in education; research 
on development Gf creative behavior; effect of programming on cieative develop- 
ment; research on programming for creative development; implications for basic 
research. 

Lx TRODUC TION . The present research to develop auto-instructional 
materials capable of developing creative behavior in students (based on materials 
developed in a creative problem-solving course) is the first stage of a contem- 
plated long-range period of research activity designed to ascertain the following: 
To what extent can auto-instructional materials provide for deliberate develop- 
ment of students' creative behavior and at the same time assure mastery of 
subject matter? The tota l project would thus couple the creative trend in Amer- 
ican education, advocated by lending educators, with the requisite acquisition of 
course content. 

In later stages, it is anticipated that incremental programs which already 
exist in subject-matter courses will be modified in such a way as to permit their 
integration with creative thinking /principles and procedures. 

A substantial foundation for the present project had already been pro- 
vided at the State University of New York at Buffalo, where the principles and 
procedures of creative problem-solving had bean developed and taught for over 
twelve years. During the latter half of this time, the validity of these principles 
and procedures had been scientifically confirmed by research projects at this 
University and at a number of ether institutions of higher learning. The specific 
purpose cf the present research, the first stage of the contemplated long-range 
project, was to program these evaluated principles and procedures. 

CREATIVITY DEFINED: Creative behavior is herein defined as behavior 
which demonstrates both uniqueness and value in its product. The product may 
be unique and valuable to a group or organisation, to society aa a whole, or 
merely to the individual himself. Thus, in behavioristic terms, creative bw- 
havior is: (1) a response, responses, or pattern of responses which operate 
upon (2) internal and/or external discriminative stimuli, usually called things, 
words, symbols, etc., and (3) result in at least one unique combination that 
reinforces the response or pattern of responses, hi general, such creative 
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behavior may be classified as discriminative, manipulative, sod evgbiptivP* 
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Creativity is thus a function of knowledge, imagination, and evaluation, 
Bruner (1962) describes learning as encompassing ’’acquisition, transformation, 
and evaluation." He is referring to creative learning, — net learning in the usual 
sense of the word. Conant (1963) emphasizes the need for better knowledge on 
the part of teachers, more acquisition . Without knowledge, there can obviously 
be no creativity. But, as Whitehead (1929) emphasized long ago, education 
should aim at "the effective utilization of knowledge." Con ant argues particu- 
larly for the tools; Bruner and Whitehead emphasize all three elements involved 
in learning. 

By way of analogy, we might consider the kaleidoscope, wherein the 
more pieces we have in the drum, the more possible patterns we can produce * 
Likewise, in creative learning, the greater our knowledge, the more patterns, 
combinations, or ideas we can achieve. However, as in the kaleidoscope, 
merely having the knowledge, the bits and pieces, does not guarantee the forma- 
tion of new patterns. In the kaleidoscope it requires the revolving of the drum, 
m the mind it requires the manipulation of knowledge, the combining and rear- 
ranging of facts into new patterns in the form of ideas. The effectiveness of 
creative productivity also depends, of course, on the evaluation and develop- 
ment of the embryonic ideas into usable ideas. 

Without knowledge, imagination cannot be creatively productive. With 
abundant knowledge, but without manipulation thereof, we again achieve no 
worthwhile creativity. Even with both imagination and knowledge available, 
but without the ability to evaluate, synthesize, and develop our potential ideas, 
we again achieve no effective creativity. Thus, creative productivity is a 
function of knowledge, ma nipulated , evaluated , and effectively develop ed into 
usable ideas. 

Torrance and Harman (1961) found that students used knowledge more 
creatively when it was learned with a "creative set" rather than with a "memory 
set." Students with the "memory set" were more restricted in finding new 
implications or more applications for the knowledge . Hyman (1962) finds that 
information, as such, may not be as important to creativity as the way one 
seeks and receives it- -as well as how he dealc with it. 

SIGNIFICANCE OF CREATIVE ABILITY IN EDUCATION: Teachers 
show an increasing awareness of the need and the opportunity for encouraging 
creative behavior (Miel, 1961; Zirbes, 1959). However, in spite of this in- 

2 




» * ***»««?** 



t 



increasing concern, our present lucalional system, to a large extent, still 
overlooks the intentional enhancement of creative ability in students. Although 
there is much amphasis on creative teaching (creative films, demonstrations, 
and other creative approaches to teaching), relatively less is being placed on 
teaching for the development of creative behavior as defined above. Most in- 
structors would be hard put to tell what their courses do, specifically and 
deliberat ely, to develop this behavior. 

Harold Rugg (1963) writes, ”We have had millions of hours devoted to 
training in solving problems by reasoning, but almost none devoted to culti- 
vation of the imagination.” And yet, Jerome Bruner (1960) states, ”It is my 
hunch that it is only through the exercise of pi ublem-solving and the effort of 
discovery that one learns the working heuristic of discovery ...” What is 
unclear, he thinks, is what kinds of training produce the best effects. 

Williams (1963), summarizing a variety of investigations, states that 
these studies have been consistent in their findings about the frequency of 
certain behaviors between teachers and pupils. Approximately one -quarter 
to one-half of the total classroom time was spent in telling students what to 
do. Another quarter was spent in providing information, mucJh of it adminis- 
trative. Only five per cent was devoted to reinforcement of the students' 
responses. (Reinforcement for creative responses was almost completely 
lacking.) In addition, the teachers allotted only about one-and-one-half per 
cent of the classroom time to decision-making functions. 

And yet, Torrance (1960) states that more effective teachers in ex- 
perimental matne atics courses (SMSG) noted more hypoth . is -making and 
evaluative thinking than did less effective teachers. H. F. Harding (1963) 
emphasizes that students must learn the skills of inquiring, imagining, in- 
cubating, expressing, selecting, and evaluating. 

Several studies have shown tht t abilities needed in typical academic 
activities are relatively independent from the abilities needed in creative 
activities (Holland, 1959, 1962; Holland and Astin, 1961; MacKinnon, 1962a, 
1962b; Taylor, 1958a, 1964; Taylor and Barron, 1963; Taylor and Holland, 
1964; Taylor, Smith, Ghiselin, and Ellison, 1961). Investigations also indi- 
cate that creative -thinking ability does contribute to achievemv>nt as it is cur- 
rently measured (Pames and Harding, 1962; Schmadel, 1960). 

The importance of the planned development of creative bel avior is 
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becoming more and more apparent to leaders in all walks of life . irving Taylor 
(in P. Smith, 1959) reports that a committee of 17 leading psychologists placed 
creativity and its cultivation at the top of a list of areas deserving the highest 
research priority in the behavioral sciences. 

Frank A. Howard, Chairman of the Sloan -Kettering Institute for Cancer 
Research, emphasized the urgency when he cited the fact that, in inventiveness, 
the United States ranks near the bottom of the list of established industrial 
countries, compared with the size of its population., * 

The U. S„ Department of Commerce has proposed extensive plans to 
assist university training in innovation, Daniel V. DeSimone (1963) includes 
the following statement in his summary of a division meeting: ’’The basic tech - 
niques of invention and innovation . . „ ought to be, but are not, among the 
fundamentals generally taught in the engineering and business schools,” The 
same should be true for students of all schools. 

Preparation for Change; As we all know, change is bewildering!/ rapid 
in our present nuclear and space age — far more rapid than ever before. The 
discoveries and innovations of the next 20 years will probably make the ac- 
complishments of the previous 100 years seem to have progressed at a snail’s 
pace. Therefore, no student can foresee exactly what knowledge he later will 
need to meet his life’s problems. He must be helped to develop the attitudes 
and thinking abilities which will enable him to meet any future problem with 
imagination as well as judgment. 

Furthermore, Maslow (1954) emphasizes that the need for self-actual- 
ization is a healthy man’s prime motivation. He says, ’’What a man can be, he 
must be.” Education for creativity -development can help achieve that goal. 

RESEARCH ON DEVELOPMENT OF CREATIVE BEHAVIOR: Research 
on development of creative behavior has been conducted on an increasing scale 
ever since the presidential address of J. P. Guilford (1950) to the American 
Psychological Association. He emphasized the ’’appalling neglect” of the study 
of creativity, indicating that of some 121,000 titles indexed in Psychological 
Abstrg ;?ts from its beginning until 1950, only 186 were definitely related to that 
subject. 

In the summer of 1958, the Creative Education Foundation, located in 

■^Reported in the Buffalo Evening News . October 19, 1960, page 70. 
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Buffalo, published the first ’’Compendium of Research on Creative Imagination," 
covering 30 studies concerned with the identification and development of creative 
ability. This comprised recent studies found in the literature at that time. 

Then, within approximately 18 months, 30 new research efforts were reported 
and summarized in a second Compendium. This also listed 28 additional re- 
search projects that had just been started — or about double the number appar- 
ently under way when the first Compendium was prepared,. 

Identification versus Development: Until the time of the first Compendium, 
projects dealt mainly with the identification of creative behavior. About half the 
studies reported in the second Compendium were devoted to the deliberate devel - 
opment of creative productivity, whereas only two such experiments were re- 
ported in 1958. Currently, the staff at SUNY/B is compiling a third Compendium 
covering the period from 1960 to 1965. A geometrically -increasing number of 
studies have already been discovered that deal with the development of creative 
behavior. Another indication of the magnitude of investigative effort in the 
general subject of creativity is that 186 dissertations were completed between 
1960 and 1964, with another 133 already reported from 1965 to the present. 

At least six research projects discussed by the Research Conference on 
Creativity at the University of Utah have indicated that creative ability can be 
measurably enhanced by planned cultivation (in C. W. Taylor, 1959). Addi- 
tional studies have recently supported the earlier findings (Pames, 1960; 

Taylor, 1964a, 1964b; Taylor and Williams, 1966). Research has also 
indicated that creative behavior can be nurtured by a more creative type of 
teaching and by deliberately providing for creativity -development in existent 
courses (Sommers, 1961; Torrance, 1960). 

Hutchinson (1962) trained teachers to modify their teaching methods so 
as to include tasks involving cognition, divergent thinking, and evaluation, thus 
having the student participate in a wide range of thought processes. When 
compared with students taught under traditional methods, the experimental 
groups (especially those of low and middle intelligence) showed greater gains 
in achievement and greater mastery of subject matter. Knight (1962) has also 
demonstrated that students can be trained to become more fluent , flexible ,' and 
original in their thinking while they are acquiring factual knowledge. 

Meinz (1960) found that a course in industrial art education for students 
majoring in elementary education led to significant increases on nine measures 



of a battery of creativity tests. The students revealed greater independence 
and a greater degree of self -involvement in their projects than did the control 
group of comparable students who had not received the course. Hoffa (1959) 
reported that art experience leads to increased independence of judgment. 
Burgart (1961) found significant positive relationships among art experience , 
measures of general creativity, certain personality variables, and aesthetic 
performance. 

Consistency of Findings: Research findings consistently demonstrate 
that creative behavior can be significantly stimulated by deliberate treatments. 
Thus, there is a confirmation of the conviction expressed over ten years ago 
by Guilford (1952): ’’Like most behavior, creative activity probably represents, 
to some extent, many learned skills. There may be limitations set on these 
skills by heredity; but I am convinced that through learning one can extend the 
skills within those limitations." 

In the same vein, Maltzman, Simon, and Licht (1959), at the University 
of California, summarized a group of research studies on originality-training 
by asserting that the results support the hypothesis that "... originality is a 
learned form of behavior which does not differ in principle from other forms 
of operant behavior." Using training procedures in free association, Maltzman 
produced highly reliable increases in the uncommonness of subjects' responses 
on two different tests. 

Detailed information about creativity research is available in a wide 
variety of sources (Taylor, 1956, 1958, 1959, 1964a, 1964b; Taylor and 
.Williams, 1966; Golann, 1963; Torrance, 1959, 1962, 1963; Stein and 
Heinz, 1960; MacKinnon, 1961; Gardner, 1964; Barron, 1963; Pames, 1958, 
1960; Parnes and Harding, 1962; Benton, 1961; Getzels and Jackson, 1962). 

Research Questions: Five major types of questions are studied in the 
research reported in the literature: 

(1) Is there a relationship between the degree of creative behavior of 
individuals and such measures as tests of cognitive functioning, personality 
tests, biographical da 1 ' analyses, and other nonintellectual instruments? 

(2) What are the effects of various factors postulated to be inhibiting 
to productive thinking? (Among these are studies evaluating the effects of 
pathological personality syndromes, experimentally induced anxiety, and ex- 
perimentally induced set.) 






(3) What is the relative effectiveness of individuals versus groups in 
problem-solving ? 

(4) To what extent can creative behavior be deliberately stimulated? 

(5) What are the relationships among creativity, intelligence, and 
achievement ? 

Prominent -/ocl of Research and Development: Research and develop- 
ment at the State University of New York at Buffalo during the first ten years 
was concerned with pilot experimentation and the development of courses, pro- 
grams, and methods designed to stimulate creative behavior in students. Ex- 
perimentation was first conducted in the evening division of the University and, 
later, in the day division. Constant revision, adaptation, and improvement 
resulted from new insights gained thr ough each experimental course and program. 

After this period of preliminary exploration, an extensive research effort 
was begun in 1958 to evaluate scientifically the results of these methods and 
programs. During the past eight years, as new knowledge was gained, intensive 
development activities paralleled the research efforts. 

Research dealt with: 

(1) the effects of a semesters program in deliberate creativity -stimu- 
lation. 

(2) the effects of extended effort in creative pr (Mem -solving. 

(3) the effectiveness of the specific creative problem-solving principle 
of deferred judgment . 

The principle of deferred judgment calls for deliberate deferment of 
judgment during idea-finding in order to prevent premature judgment from 
hampering imagination, judgment being applied after a wide variety of alter- 
natives is listed. This principle is equally applicable to individual idea-finding 
effort and to creative collaboration by groups. Studies covered the use of this 
principle both by individuals and groups. 

Major findings at SUNY/B were as follows: 

(1) The semester program resulted in significant increments on the 
two measures of quantity of idea-production and on three out of the five measures 
of the quality of the ideas produced. In general, these increases in creative 
productivity remained evident in another group of students who were tested from 
one to four years after taking the course. A significant increment on the Cali- 
fornia Psychological Inventory Dominance Scale also resulted from the program. 
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(2) Significantly more good-quality ideas were produced by individuals 
under deferred-judgment instructions than under concurrent -judgment instruc- 
tions. (Criteria included uniqueness and usefulness of ideas.) The subjects 
trained in a creative problem-solving course emphasizing the principle of 
deferred judgment produced a significantly greater number of good-quality ideas 
when using the technique than did the untrained students. (The same criteria 
were employed.) 

(3) Groups producing ideas on a problem were more productive of good- 
quality ideas when adhering to the deferred -judgment principle than when em- 
ploying the more conventional discussion methods which entail concurrent 
evaluation of ideas. Groups which adhered to the deferred-judgment principle 
when generating ideas were likewise more productive of good-quality ideas than 
the same number of individuals working independently under conventional methods 
which entail concurrent evaluation of ideas. 

(4) Extended effort in idea-production resulted in a greater proportion of 
good ideas among the later ideas produced. 

Summaries of the detailed findings and procedures regarding these studies 
may be found in A Source Book for Creative Thinking (Parnes and Harding, 1962) 
and Parnes (1963). 

The new knowledge derived at SUNY/B and elsewhere has been incorporated 
into its developmental activities. Annual Institutes have been held for the past 
twelve years at the University for the study of research and developments in edu- 
cation, industry, government, and national defense. The knowledge resulting 
therefrom has been integrated each year within new programs at the University. 
The Thirteenth Annual Institute is scheduled for June, 1967. About 400 will par- 
ticipate in this five-day program. 

Experimental instructor's manuals and workbooks have been developed 
and constantly revised over the past eight years. Two experimental workshops 
have been held, one for a group of some 60 history teachers and the other for 
another group of 40 high school teachers. These workshops were designed to 
help teachers integrate creativity -development with instruction in subject-matter. 

Although there are many investigators and organizations that have made 
significant contributions to the area of creativity, there are at least five uni- 
versities (besides SUNY/B) which have made major efforts in this direction 
over an extended period of time. Perhaps the earliest full-scale project was 



initiated by J. P. Guilford and his associates at the University of Southern 
California . Although Guilford's total work is not aimed specifically at crea- 
tivity, his studies on the aptitudes of high-level personnel and his theory on 
the "Structure of the Intellect" have had major implications for both research 
and developmental programs in creativity. 

Another highly productive group has been the Department of Art Edu- 
cation at Pennsylvania State University . Initially, this group was headed by 
Victor Lowenfeld, a pioneer in research on art education and creativity. 

However, after Lcwerfeld's untimely death, Kenneth Beittel assumed leader- 
ship and has continued to demonstrate considerable progress. The main con- 
cern at his institution has been the matter of criteria and predictors of creative 
art performance. Nevertheless, this group has also made significant contribu- 
tions to the development of general creative performance through methods of 
art education. 

Another significsint influence has come from the six national conferences 
on the Identification of Creative Scientific Talent under the direction of Calvin 
Taylor at the University of Utah. In addition to holding conferences, Taylor and 
his associates have made major contributions to the body of knowledge concerning 
the criteria and predictors of creative and scientific talent . They have also con- 
ducted workshops for teachers. 

The Institute of Personally Assessment and Research at the University 
of California, under the direction of Donald MacKinnon, has also devoted a con- 
siderable amount of effort to creativity research. At this institution. MacKinnon, 
Barron, Gough, and others have concerned themselves especially with the as- 
sessment of the personalities of creative writers, artists, scientists, and 
architects. 

Perhaps the most prolific writer in the area of creativity and education 
is E. Paul Torrance at the University of Min nesota . Torrance and his as so- 
elates have developed assessment methods for identifying creative talejt at all 
age -levels, from the elementary grades through graduate school. They have 
studied methods and conditions which affect creative growth, both in and out of 

the classroom. Manuals, workbooks, and tape recordings have been developed 

»* 

on the elementary and secondary levels by Torrance and his associates. 

Other researchers in the nation have also developed programs and mate- 
rials in conjunction with their efforts. At the University of Illinois, a program 
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of ’’inquiry training" has been constructed to help elementary school students to 
ask insightful questions and thus to discover scientific principles on their own 
(Suchman, 1960). Drews (1963]i at Michigan State University, prepared films 
and a flexible textbook for secondary -level students. Crutchfield prepared arc' 
evaluated a self -instructional program developing creative behavior in children. 
The results of that evaluative study are referred to in a later section of this 
report (Olton, 1966). 

Synectics programs, involving techniques for creativity -stimulation in 
groups, have been developed on the adult level (Gordon, 1961). Teachers' 
workshops were conducted at San Jose State College. These workshop pro- 
grams included the development of instructional materials emphasizing cre- 
ativity, Melbourne High School and Webber College (Staake, 1963) in Florida 
have been experimenting with a variety of approaches to the stimulation of 
creative behavior. Other recent experimenters included Amran (1966) , Brown 
(1965), Eberle (1965), and Williams (1966). Razik (1965) compiled the most 
comprehensive bibliography on creativity to date. Among its 4, 176 references 
are scores of studies regarding experimentation in the stimulation of creative 
behavior. 

In addition, many experimental efforts in course -offerings have been 
made at educational institutions throughout the nation. One index of growth is 
the fact that, during each of the past several years, the Creative Education 
Foundation has supplied instructor's manuals to about 1,500 potential teachers 
of such courses in educational institutions, in industrial organizations, in the 
military, and in governmental agencies. The Air Force has incorporated 
creative problem-solving into its ROTO curriculum on some 200 campuses. 

The United States Army Management School at Fort Belvoir, Virginia, has 
conducted several three -day creative problem-solving seminars, including 
one designed primarily for Service School instructors. An instructor's manual 
for a ten-hour course in military creative problem-solving has been produced 
by the Management School for use by Service Schools throughout the Army. 

In addition to the teaching of creative problem-solving per se , the past 
few years have seen a widespread integration of creativity principles and pro- 
cedures with conventional courses. Three outstanding examples of courses 
which have thus been modified are: the economics course by Jere Clark of 
Southern Connecticut State College , the physics course developed by Myron 
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Allen of Technical Service Research in Los Gatos, California, and the mar- 
keting course conducted by Harry Hansen of Harvard University. The United 
States Army Management School provides a notable example of the formal 
integration of the creative problem-solving method within the ’’case” approach. 
The known examples of integration of creativity-development include 195 dif- 
ferent subjects (Osborn, 1965). 

The value of such course -modification has been further indicated by the 
research regarding the effectiveness of similar integration of creativity prin- 
ciples and procedures with conventionally -taught courses in language arts. As 
a result of this creativity -orientation, Torrance (1962) found a significant gain 
in the creative writing ability of the students attending this course. Also, a 
study by Sommers (1961) reports his discovery that mastery of subject-matter 
increased, as did creative ability scores, as a result of a similarly integrated 
course. 

EFFECT OF PROGRAMMING ON CREATIVE DEVELOPMENT. Re- 
search suggests that incremental teaching of subject-matter can be more 
efficient than conventional teaching methods. For example, the findings of 
Galanter (1959) showed that students could master a programmed course in 
spelling four times faster than a conventionally -taught course. The first 
comprehensive source book on programmed learning reported a number of 
pilot research projects which indicate an increase in teaching efficiency 
(Lumsdaine and Glaser, 1960). Schramm's (1964) annotated bibliography 
cites 36 studies, of which 17 showed significant superiority for students who 
completed programs as compared with those in conventional classes. In all 
but one of the remaining 19 studies, no significant differences appeared. In 
the one exception, the classroom students proved superior to the programmed 
ones . 

As a result of the encouragement of research, auto-instructional pro- 
grams are appearing at a rapid rate in practically every academic field. In- 
asmuch as the effective programming of a textbook is a costly and time- 
consuming process, many forward-looking educators are asking themselves 
whether they should reconsider the entire curriculum before developing pro- 
grams. This would enable them to incorporate the benefits of any improvements 
into the new programs froip. the start. By the same token, it seems opportune 
and appropriate to seek ways of programming the much-sought creative devel- 
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opment of students and ultimately, in later stages, to attempt to incorporate 
this into the newly emerging auto-instructional materials in all fields. Thus 
an opportunity may be provided to plan for the creative development of stu- 
dents through the new programs. 

Many auto-instructional authorities are concerned about development of 
creative behavior. Kendler of New York University has stated, "We are faced 
with a serious threat to our national scientific creativity, " and claims this is 
because our language habits are becoming less abstract, more concrete, and 
more standardized (Galanter, 1959). Stone, of the Department of Health, Edu- 
cation and Welfare, h~s voiced a common concern of many educators in his 
statement: "There is a need for more research in the effects of the new media 
on creativity and on higher thought processes" (HEW, 1961) . 

Can Creative Behavior Be Programme d? Many psychologists who con- 
duct research in teaching machine programming think that this can be done. 
Skinner (1961) has written that "teaching machines are by no means confined 
to imparting explicit repertoires of behavior." That is, programmed learning 
can require the student to produce more than one "right" or appropriate answer. 
Klaus of the American Institute of Research writes: "The third level of instruc- 
tion involves the teaching of such capabilities as creative thinking and judgment. 
Tnis last level of education may be the area in which auto-instruction will yield 
its greatest fruits. The possibilities of developing a program in this area are 
derived from two simple observations. First, we have sufficient data to indi- 
cate that creativity and judgment are examples of learned behavior. Second, 
we have eviderce to indicate that these behaviors can be taught. What is left 
is simply a matter of mechanics: that is, identifying exactly those behaviors 
to be learned and then finding the means to successfully establish these be- 
haviors in the student's repertoire with auto-instructional methods and devices" 
(Klaus and Lumsdaine, 1960). 

Other psychologists provide further emphasis. Guilford (1961) wrote, 

"It has seemed to me that it should be possible to introduce training for crea- 
tive performance by means of modified programs for the machines." Maltzman 
et al. (1958) have already found that reinforcement can strengthen originality. 
Cowen (1952) discovered that reinforcement by praise resulted in less rigidity 
in problem-solving. Carl Rogers (1965) told a symposium that, although pro- 
grams are wel T suited for shaping people to "fit" into society, they can also be 



used to release creative potential . 

RESEARCH ON PROGRAMMING FOR CREATIVE DEVELOPMENT. 
Authorities emphasize the value of creative thinking in programming, but give 
much less attention to programming deliberately for creative development. 

Very little of the teaching machine research reported in the literature deals 
with creative thinking. Barlow (1960) conducted a project in which students 
were presented alternatives, neither of which was coriect. By allowing the 
students to discover this, and then having them develop a third correct form, 
he hoped to teach them to think for themselves . Klaus (1961) has been devel- 
oping programs for teaching independent thinking and judgment, as well as 
creative writing. Day (1961) has begun a study on thinking and problem-solving. 
Crutchfield initiated a project on auto-instructional methods and creative 
thinking for fifth and sixth graders under a grant from the Carnegie Corporation. 
He obtained strong positive results which are summarized by his associate, 

Olton (1966), as follows: ". . .in general, children who went through the pro- 
gram scored more than twice as high on the post-test as the control children . • • 
This very large difference existed over a broad range of creative thinking 
skills; ..." 

IMPLICATIONS FOR BASIC RESEARCH. Auto-instructional research 
is usually aimed at ascertaining factors in learning efficiency and determining 
to what degree each factor or variable can be varied, alone or in combination, 
in order to develop optimum efficiency in learning. Some variables are func- 
tions of the machines, some are functions of the program, some are functions 
of the students or their environment, and some are functions of all four. 

Such learning variables are also creative variables; i.e. , the more we 
learn, the more ideas our imaginations have to manipulate. This does not 
mean, however, that factors which effect learning will necessarily have the 
same relative effect on creative behavior and vice versa. It seems obvious, 
however, that while certain aspects are stressed more in creative behavior 
than in learning and vice versa, the optimum situation would be a happy 
balance between the two. 

It follows that research regarding creative behavior should closely 
accompany auto-instructional research. Any future research which reveals 
that a certain procedure has impact upon learning effectiveness should be 
checked to ascertain whether it is also helpful or detrimental to creative 
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development. This, of course, opens up new fields of basic research in crea- 
tive behavior. For instance, if reading speed, eyespan, speed -of -association, 
and other such factors increase retention and comprehension , this does not 
necessarily mean that they also enhance creative development. When one 
considers the part played by incubation in creative thinking, one realizes that 
the variable "time" may bear so complex a relationship to creative thinking 
that much research will be needed on this point. Incidentally, research has 
already indicated that "uncommonness and remoteness of response" increase 
with time, while "cleverness" has been found to be independent of time 
(Christensen et al. , 1957). 



II. OBJECTIVES OF THE RESEARCH 



General Objective . The hypothesis tested was that scores on creative 
ability tests can be significantly increased through a program developed to 
present incrementally the principles and procedures of a creative problem- 
solving course. As a by-product, the effect of such a program on student 
attitudes toward the course was also studied. 

Specific Objectives . 

(1) To reduce various creative abilities — fluency, flexibility, origi- 
nality, elaboration, and sensitivity -H;o their manifestations in defining and 
solving problems creatively. That is, using the principles and procedures of 
a creative problem-solving course, creative abilities were reduced to actual 
behavior which manifests these traits and abilities. In. behavioristic terms, 
fluency is defined as the ability to generate many responses (ideas) in response 
to one discriminative stimulus (problem) . Flexibility is defined as the ability 
to generate many different classes of responses (ideas) in response to one dis- 
criminative stimulus (problem) . Originality is defined as the ability to create 
a response that is statistically uncommon. Elaboration is defined as the ability 
to generate many responses (details) that implement or spell out an idea which 
serves as the discriminative stimulus. Sensitivity is defined as the ability to 
generate many problems or challenges as responses to a situation or observa- 
tion that serves as the discriminative stimulus . 

(2) To devise means of immediately reinforcing any response showing 
any slight tendency towards such creative behavior. Such reinforcement was 
constructed so that it was not limited to only one correct response. Rather, 
reinforcement was provided for any response that was considered acceptable 
and met criterion standards. 

(3) To conduct error-analyses and revise the program as necessary 
for optimum effectiveness. 

(4) To ascertain, by using experimental and control groups in a pre- 
testing and post-testing design, to what degree this "optimum" program in- 
creases the students' creative behavior as measured by various creative 
ability tests . The purpose of the control groups is to provide a base line for 
differentiating between improvement due to the treatment effects and that due 
to general growth and practice effect. 

(5) To determine, by the use of experimental and control subjects. 
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whether or not subjects receiving creative problem-solving training by pro- 
grammed methods alone show increases in creative ability to the same extent 
as do subjects receiving the same error-free programmed materials by 
instructor-taught methods, and whether or not either or both of these groups 
show a significant gain in creative ability when compared with control subjects 
receiving no training. 

(6) To study the attitudes toward the course of students taking the pro- 
grammed version alone as compared with those receiving the programmed 
material via an instructor. 
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III. PROCEDURE 

A Chronological Outline of the Development and Evaluation 
of the Programmed Materials 

Fall, 1963 

Completion of first set of five pilot programmed-booklets on the following 
phases of the creative process: Orientation <two booklets) , Observation, Mani- 
pulation, and Evaluation. 

A. Experimentation and error-analysis of the above with three groups: 

1. Fifty day and evening students of creative problem-solving 
courses at State University at Buffalo; 

2. Fifteen engineers and other personnel in a value engineering 
course at Sylvania Electronic Systems; 

3. A volunteer Creativity Programming Committee made up of 
about ten faculty of SUNY/B and several evening instructors from edu- 
cation and industry. 

Spring, 1964 

A, Pilot testing of above at Sylvania, using Guilford creativity tests on 
experimental and control groups. The control group received comparable 
training from an instructor of creative problem-solving of Syl vania's central 
staff. Although proper sampling and experimental controls were lacking, and 
although rigorous statistical tests were not computed, results did indicate that 
the post -test scores of students taking the program were approximately equiva- 
lent to those of students who had instructor-training. There was even some 
indication of greater originality and sensitivity on the part of the program - 
students. 

B. First and second major revisions of Observation and Evaluation 
booklets, based on all error -analysis and feedback mentioned above. 

Summer. 1964 

A. Experimentation and error-analysis on Observation and Evaluation 
booklets with 250 new enrollees in Tenth Annual Creative Problem-Solving 
Institute, June of 1964, plus 150 faculty and leaders at same Institute. 

B . Analysis and critique of above by consultants during and after above 
Institute, as well as by special group of leaders at the Institute. 

Reactions were most encouraging with respect to participants 1 attitudes 
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toward the program. These experimental materials were introduced in place 
of the skilled and enthusiastic instructors who would otherwise have conducted 
the particular sessions. In spite of this, and in spite of the fact that the par- 
ticipants had not expected to be given any programmed materials, 87 per cent 
found the experience from '’acceptable” to "highly enjoyable”; only 13 per cent 
found it "distasteful” or "very distasteful.” 

As to the effectiveness of the programmed instruction, 52 per cent of 
the participants telt it was "capable” or "superb,” 33 per cent "passible,” and 
15 per cent "poor” or "terrible.” Significant improvements were made in the 
newer versions, based on the reactions and recommendations. Of course, the 
comments herein refer to participants' reactions only, rather than to measured 
effectiveness in improving creative ability. However, the experimenters were 
much concerned with participants' attitudes because of the widespread feeling 
among creative problem-solving instructors that "you cannot program creative 
behavior.” 

C. Experimentation and error-analysis on Observation booklet with 
fifty students in psychology class at Cornell University. (Half were admin- 
istered Revision 1, half Revision 2.) 

Results: As to student preference, results were inconclusive. Each 
version received comparable feedback in terms of preference of those 
who took it at Cornell. (The same was true at the Institute.) However, 
based on a post -test on a creative task given to the Cornell students , 
the first experimental version appeared more effective. Hence, the 
decision was made to follow that style of programming for the present 
research. 

D. Experimentation with Observation booklet with a group of 22 super- 
visors at Headquarters. U. S. Army Tank -Automotive Center, Warren. Michigan. 

Fall, 1964 

Third major revision of Observation and Evaluation booklets, based on 
error-analyses and feedback from 400 Institute members and 50 Cornell stu- 
dents. First major revision of Orientation and Manipulation booklets; con- 
struction of remaining booklets. 

A. Construction of five consecutive Observation booklets and two con- 
secutive Evaluation booklets . 
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B. Revamping of Manipulation booklet into six consecutive booklets, 
based on experiences with Observation booklets. 

C. Reconstruction of two Orientation booklets into series o£-&ixJ>ooklets, 
based on (1) error-analyses described under Fall, 1963, on page 17, (2) exper- 
ience with other booklets, and (3) feedback from about two dozen individuals. 

D. Construction of remaining booklets to make a total of 30. 

E. Experimentation and error-analysis with 25 students (SUNY/B day 
students in a creative problem-solving course). 

F. Feedback from the students. This confirmed the need for the rese- 
quencing of the course. 

t 

Spring, 1965 

Major revision and resequencing of entire 30 booklets , based on student 
reactions and error-analysis mentioned in E above. 

A. Error-analyses of all 30 booklets on three new groups: (1) three 
paid college -students, (2) 15 SUNY/B day students in a creative problem-solving 
course, (3) 20 college -bound high school seniors at one of Buffalo's city high 
schools. 

B. Editing and revising of booklets by staff and eight consultants, in 
preparation for testing of the experimental hypotheses. Special attention was 
paid to necessary changes in timing so as to allow the slower students to com- 
plete the basic material in a single class period, yet to provide enough supple- 
mentary exercises to challenge the faster ones for the entire period. The 
booklets were thus designed so that each student could "stretch" his imagination 
for a full 40 minutes on each one. This is important because the course is con- 
cerned with relative gains of each individual. There are no absolute standards 
against which he is measured. 

Summer. 1965 

Preparation for major experimental evaluation of finished booklets. 

A. Restructuring of 30 booklets into 26 course sessions. Some booklets 
were combined as a result of the last error -analyses. The final set includes 28 
booklets for the 26 sessions. (Two booklets each — a Part A and a Part B — are 
designed for two particular sessions -^thus 28 booklets instead of 26.) 

B. Printing and preparation of the final booklets. 
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Fall, 1965 

A. Setting up matched experimental and control groups from 1,086 
volunteers for the final experiment. Six academic high schools in the Buffalo 
Public Schools were included in the major experiment; the remaining two aca- 
demic high schools were used for additional pilot -experimentation. 

B. Conducting pre-testing, experimental courses, and post -testing. 

C. Computing reliability of scorers. 

D. Scoring of tests. 

E. Revision of booklets into two additional forms: (1) a "long -form," 
which provides all "convergent" responses but leaves blanks for all "divergent" 
responses; (2) a "no-response" form, which leaves blanks for all responses as 
did the original set, but which does not provide the printed response as rein- 
forcement. 

F. Preparations for the control students of the present experiment to 
take the course in the spring as they had been promised. The different types 
of program -format (described in E above) were then available for pilot -experi- 
mentation in the spring classes. Thus preliminary evaluations will be possible 
of the relative effectiveness and student -preferences of different booklet -formats, 
as well as of different modes of instructor-involvement with the presentation of 
the materials. 

G. Completion of another error-analysis, on the booklets used by the 
experimental students. Even though all of the booklets had been thoroughly 
error-analyzed before, minor modifications were suggested by the feedback 
from the large group of students who took the programs. All of these changes 
were incorporated into the revised copies prepared for the spring classes. 

H. Preparation of a final questionnaire to obtain thorough feedback on 
student reactions . Session-by -session feedback had also been obtained through 
brief questionnaires in each of the booklets. 

Spring, 1966 

A. Analysis of results of major experiment. 

B. Pilot-experimentation in all eight schools with respect to the three 
types of booklets and with respect to different modes of teacher-involvement in 
the learning process. 



